METHOD AND SYSTEM FOR ADAPTIVE COLOR 
AND CONTRAST FOR DISPLAY DEVICES 

CROSS-REFERENCES TO RELATED APPLICATIONS 

[0001] This application is a continuation of U.S. Application No. 10/193,348 filed July 
10, 2002 entitled "Method and System for Adaptive Color and Contrast for Display 
Devices" which is hereby incorporated by reference. 

FIELD OF THE INVENTION 

[0002] The present invention relates generally to display devices and particularly to a 
system and method that provides adaptive color and contrast for a display device. 

BACKGROUND OF THE INVENTION 

[0003] A display device renders input data as a two-dimensional image in color or 
grayscale. The input data may be graphical in nature. An example of such a device is a 
PC display monitor. The input data may be a video signal. An example of such a device 
is a TV or video monitor. The input data may be a combination of graphics and 
embedded video. An example of such a device is a PC display monitor displaying 
graphics with one or applications displaying video in a window, or a PC/TV display 
device with two or more input ports displaying graphics or full-screen video or a 
combination of graphics and video, e.g. Picture-in-Picture. 

[0004] A viewer typically manually controls the color and contrast of a display device. 
The issue with manual control is that it does not result in optimal display quality for all 
possible input data. For example, setting the contrast control to increase the contrast of a 
washed out image will result in over-contrasty images for a normal image. Decreasing 
the color saturation setting for a highly saturated image would be optimal, but if the input 
changes to a de-saturated image, this setting would now be sub— optimal. It is not feasible 
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or convenient for a viewer to continuously change display settings to adapt to the nature 
of the input image, particularly when the input is a video sequence. 
[0005] Another problem with manual control of contrast and color is that it is not 
sensitive to the nature of the input data. Manual contrast control applies a multiplicative 
factor to the input luma component. This is shown graphically in Figure 1 . Due to the 
finite dynamic range of luma values, increasing the contrast of a dark image in order to 
be able to see the shadow details results in loss of information in the bright highlights. 
The multiplicative nature of this control also implies that there is no possibility of 
increasing the contrast of a predominantly bright image. 

[0006] Accordingly, what is needed is a system and method to address the above-identified 
problems. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

[0007] A method and apparatus that allows a display device to adaptively and 
automatically control display contrast and color is disclosed. The method and system in 
accordance with the present invention can be described by the following sequential 
process: 

1 . Separating an input image data value into its luma and chroma 
components. 

2. Collecting the luma distribution data over the entire image or a specified 
window. 

3. Analyzing the luma distribution. 

4. Generating an appropriate contrast control response that modifies the 
input luma component to generate an output luma component, on a pixel by pixel basis. 

5. Analyzing the input luma component and the output luma component, and 
an input chroma component, to generate an appropriate modification for the chroma 
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component, on a pixel by pixel basis. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a standard contrast adjustment. 

Figure 2 is a flow chart illustrating adaptive color contrast in accordance with the present 
invention. 

Figure 3 illustrates a "snapping" process. 

Figure 4 illustrates the dark range case and its transfer function. 

Figure 5 illustrates the mid-tone range case and its transfer function. 

Figure 6 illustrates the bright range case and its transfer function. 

Figure 7 illustrates modifying the blended contrast control response so that display 

dynamic range is fully utilized. 

Figure 8 shows a representative hardware data path diagram. 
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DETAILED DESCRIPTION 

[0008] The present invention relates generally to display devices and particularly to a 
system and method that provides adaptive color and contrast for a display device. The 
following description is presented to enable one of ordinary skill in the art to make and use 
the invention and is provided in the context of a patent application and its requirements. 
Various modifications to the preferred embodiment and the generic principles and features 
described herein will be readily apparent to those skilled in the art. Thus, the present 
invention is not intended to be limited to the embodiment shown but is to be accorded the 
widest scope consistent with the principles and features described herein. 

Definitions 

[0009] Digital Display Device: an electronic image display device that uses digitized 
(sampled and quantized) image data. The input data itself may be analog in nature, and 
digitized within the device for display on a digital display such as an LCD, OLED or 
plasma panel. Alternatively, the input data itself may be digital in nature and finally 
displayed on an analog display such as a CRT. 

Pixel: the smallest discrete region on a digital display device that can be 
addressed for display. 

Luma: the component of the input image data value that is correlated to the 
perceived intensity of the displayed data value. 

Chroma: the component of the input image data value that is correlated to the 
perceived color of the displayed data value. Hue and saturation are two commonly used 
color perceptions that together define the chroma value. 

[0010] A system and method in accordance with the present invention continuously 
analyzes the input data and responding by manipulating the color and contrast of the 
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display device. The system is both adaptive and automatic. The term adaptive is used to 
signify that the proposed solution continuously generates an appropriate response based 
on an analysis of the input data. The term automatic is used to signify that there is no 
viewer interaction required for this process. 

[0011] The apparatus in accordance with the present invention may be hardware, 
software, or a combination of hardware and software. An example of a pure hardware 
solution would be an FPGA or ASIC design. An example of a hardware and software 
implementation would be a DSP and embedded firmware. 

[0012] The method and system in accordance with the present invention is described in a 
preferred embodiment by the below-identified sequential steps in conjunction with 
Figure 2. Figure 2 is a flow chart illustrating adaptive color contrast in accordance with 
the present invention. 

1 . Separating an input image data value into its luma and chroma 
components, via step 103. 

2. Collecting the luma distribution data over the entire image or a specified 
window, via step 104. 

3. Analyzing the luma distribution, via step 106. 

4. Generating an appropriate contrast control response that modifies the 
input luma component to generate an output luma component, on a pixel by pixel basis, 
via step 108. 

5. Analyzing the input luma component and the output luma component, and 
an input chroma component, to generate an appropriate modification for the chroma 
component, on a pixel by pixel basis, via step 110. 

Each of the steps will be described in detail hereinbelow. 
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Separating input data into luma and chroma components; (step 10?) 

[0013] If the input data is already formatted as luma+chroma, this process is not 
required. If the input is in some other format, such as RGB, this process will generate the 
luma and chroma components. 

Collecting Inma distribution data (step 104) 

[0014] This process divides the range of luma values into a number of overlapping bands 
and counts the number of input luma data values that fall within each of these bands, 
over the entire image or a specified window in the image. An image window will 
normally be specified when the desired control response needs to be confined to a 
window on the screen. This window could for example be a Picture-In-Picture video 
window, or an embedded video window within a graphics screen. 

[0015] At the end of this process, the luma distribution is defined by a set of band indices 
and their corresponding counts. This statistical distribution table is the luma histogram. 
[0016] In addition, the darkest and brightest luma data values found are also stored. 
These values can be either determined by the actual minimum and maximum values 
found in the image, or from a cumulative analysis of the luma histogram. For example, 
the minimum luma could be determined as the value beyond which 99% of the image 
luma values are found. The maximum luma could be determined as the value below 
which 99% of the image luma values are found. 

Analyzing luma distribution data (step 106) 

[0017] If the input data luma range is very evenly distributed over the range from black 
to white, this will reflect in the count values being approximately equal. If the input data 
luma values are clustered around certain portions of the entire range, this will reflect in 
different count values for different bands. 
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[0018] For example, a relatively high count in the lower bands corresponds to a 
predominantly dark image. A relatively high count in the upper bands corresponds to a 
predominantly bright image. A relatively high count in the middle bands corresponds to a 
mid-tone image. For each of these image categories, it is possible to pre-define an 
optimal contrast control response. 

[0019] The darkest and brightest luma data values indicate the dynamic range of the 
input luma data. If this is less than the available dynamic range available, it is desirable 
to remap the luma values to fully utilize the available dynamic range for maximum visual 
quality. For example, assuming a normalized luma range of 0 to 1 , if the darkest luma 
value is 0.2 and the brightest luma value is 0.9, it is possible to remap the input range of 
0.2-0.9 to the range 0.0-1.0. This "snapping" process is shown in Figure 3. 

Generating appropriate contrast control respons e (step 1 Oft) 

[0020] This method specifies an optimal contrast control response for a limited subset of 
the universe of possible luma distributions. For example, if three luma bands are used for 
analysis, it is possible to specify three control responses that are optimal for the following 
cases : 

[0021] Dark image: relatively high band count in first band, compared to other two bands 
[0022] Mid-tone image: relatively high band count in middle band, compared to other 
two bands 

[0023] Bright image: relatively high band count in last band, compared to other two 
bands 

[0024] For the dark image case, a suitable contrast control response expands the dark 
image pixel dynamic range, and compresses the bright pixel dynamic range. Figure 4 
illustrates the dark range case and its transfer function. 

[0025] For the mid-tone image case, a suitable contrast control response expands the 
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mid-tone dynamic range, and compresses the dark and bright image dynamic range. 
Figure 5 illustrates the mid-tone range case and its transfer function. 
[0026] For the bright image case, a suitable contrast control response expands the bright 
pixel dynamic range and compresses the dark pixel dynamic range. Figure 6 illustrates 
the bright range case and its transfer function. 

[0027] These control responses are user definable so that any desired contrast control can 
be applied. 

[0028] For an actual input luma distribution, the relative luma counts in the different 
bands are used to determine how well the actual luma distribution correlates to the 
chosen subset of luma distributions. 

[0029] This method then blends the predefined control responses for the subset of luma 
distributions using the relative luma counts as a blending weight. For example if the 
actual luma counts are relatively high in both dark and mid-tone bands and low in the 
bright region, the blending process will generate a control response that is predominantly 
a blend of the appropriate control responses for dark images and mid-tone images. 
[0030] Finally, the computed darkest (Xmin) and brightest (Xmax) luma values are used 
to modify the blended contrast control response so that display dynamic range is fully 
utilized. This is shown in Figure 7. 

Analy zi n g m odified luma followed by generation of non-linear chroma correction factor 
(ste p 1 10 ). 

[0031] This method analyzes on a pixel by pixel basis the incoming luma value and 
outgoing modified luma value, and generates an appropriate adjustment for the chroma 
component. The chroma adjustment maintains or enhances the perceived color saturation 
of the picture when the contrast has been increased. 

[0032] The chroma correction applied is determined by the difference between the luma 
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output and the luma input to the luma LUT and is non-linear. If the incoming pixel 
already is highly saturated, the amount of additional chroma correction is decreased. 
[0033] A representative hardware data path diagram 200 is shown in Figure 8. In this 
figure, a controlling state machine 202, receives a vertical data enable signal and an input 
luma signal. The state machine 202 controls a creation of histogram black 204, a 
histogram average 206, template weight calculator 208, a template transfer function black 
210 and a snapping function block 212. Memory 214 stores average histogram and the 
previous histogram. Memory 216 stores the template transfer function. 
[0034] The snapping function block 212 provides final blended transfer function to 
memory 218. The memory receives input luma and provides an output luma. The input 
luma, output and the input chroma is provided to the adaptive chroma correction block 
220. The adaptive chroma correction block provides the output chroma. 
[0035] In this system, the collection of the current image histogram is performed during 
the active frame which is signaled, for example, by the vertical data enable signal at logic 
1 . When the vertical inactive period (blanking) starts, the histogram is averaged if 
necessary with previous image histograms. Then the template transfer function weights 
are calculated and the template transfer functions are blended using these weights. 
Finally the snapping operation is done on the blended output to recover the full dynamic 
range and the new contrast transfer function is written to the luma LUT memory. This 
new lookup table is used for the next image frame. 

[0036] Although the present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will readily recognize that there could 
be variations to the embodiments and those variations would be within the spirit and scope 
of the present invention. Accordingly, many modifications may be made by one of 
ordinary skill in the art without departing from the spirit and scope of the appended claims. 
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